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A  METHODOLOGY  AND  ANALYSIS  FOR  COST-EFFECTIVE  TRAINING  IN  THE  AN/TSQ-73 
MISSILE  MINDEF 

INTRODUCTION 

A  training  developer  faces  two  fundamental  problem  areas  in  perform¬ 
ing  a  cost  and  operational  effectiveness  analysis  (COEA) .  The  first  is 
to  determine  what  will  be  taught,  what  training  hardware  is  needed,  and 
where  that  hardware  will  be  used.  The  second  is  to  insure  that  the 
method  used  optimizes  the  effectiveness  of  a  given  student  population. 
Effectiveness  is  defined  as  the  change  in  performance  from  a  pre-instruc¬ 
tion  level  to  a  post-instruction  criterion. 

Training  decisions  must  be  made  in  real  dollar  terms,  reflective  of 
differences  in  the  training  varicibles.  The  entire  process  from  training 
decisions  through  costing  is  a  multivariate  task  involving  many  inter¬ 
acting  factors  and  a  variety  of  potential  methodologies.  The  usual  task 
of  the  researcher  in  developing  a  particular  methodology  consists  of 
selecting  which  approach  to  use  and  then  validating  whether  or  not  the 
final  product  does  in  fact  represent  a  real  improvement  over  already 
existing  procedures.  In  the  real  world  this  is  a  time-consuming  and 
expensive  process.  As  an  alternative,  the  opposite  approach,  the  non- 
empirical  expert- judgement  method,  also  falls  short  of  ideal.  The  com¬ 
promise  approach  presented  in  this  paper  systematizes  the  decision  pro¬ 
cesses  for  elements  that  are  too  expensive  to  validate,  and  combines  them 
with  elements  that  can  be  validated.  This  approach  is  based  on  the  idea 
that  improvemen ,  is  almost  always  possible  by  systematizing  the  applica¬ 
tion  of  the  selected  technique,  whether  that  technique  has  been  field 
proven  as  optimal  or  not. 

At  some  point  in  the  research  effort  it  is  essential  to  create  real 
training  programs  for  weapon  systems  and  to  do  a  complete  costing  and 
performance  evaluation  of  each  student  population.  This  is  needed  not 
only  to  validate  the  techniques  for  generating  costable  alternatives, 
but  also  to  determine  what  the  interactions  are  between  the  types  of 
training  programs  and  later  performances.  Without  such  empirical  evalua¬ 
tion,  all  methods  would  ultimately  be  reduced  to  educated  guessing, 
dependent  totally  on  the  ability  of  the  analyst  to  predict  transfer  of 
training.  Even  so  sucl:  a  full-scale  test  is  an  expensive  and  large-scale 
effort  which  should  be  undertaken  only  with  extensive  advance  planning 
.o  assure  that  the  results  can  be  advantageously  used  in  later  cost 
estimations . 

Three  goals  were  paramount  in  the  selection  of  the  approach  presented 
in  this  paper.  The  first  goal  is  flexibility.  An  adequate  technique 
must  be  1)  capable  of  incorporating  changes  resulting  from  new  research 
information,  2)  capable  of  handling  managerial  variables  affecting  local 
and  army-wide  decisions,  3)  able  to  adjust  to  different  costing  techniques 
and  4) adaptive  to  a  wide  variety  of  conditions.  As  a  second  goal,  the 
technique  must  be  easily  described,  quickly  learned,  and  inexpensive. 
Finally,  the  technique  must  interface  smoothly  with  existing  Training  and 
Doctrine  Conunand  (TRADOC)  structure  and  be  able  to  easily  incorporate  new 
p.-ychological  research  relating  to  transfer  of  training,  decision  making. 


and  utility  theory.  Co»t"efft^ctiv«ness  analysis  depends  in  part  on  psy¬ 
chological  research  in  task  and  skill  analysis  which  categorixea  tlte 
critical  fincttons  that  a  training  device  must  reflect.  Thin  research 
alone  will  not  predetermine  what  kind  of  training  system  will  be  chosen 
boc.ause  it  constitutes  only  one  dimension  of  a  multidiiminaional  decision 
space.  Witli  a  multidimensional  framework  in  mind,  the  training  developer 
must  select  that  particular  conglomeration  of  hardware  and  courseware 
materials  which  most  effectively  reflects  tlie  actual  training  needs  of 
the  given  weapon  ayatem,  Thi»  task  la  neither  obvious  nor  subject  to 
easy  solutions,  and  any  metliod  that  is  proposed  must  make  conscious  trade¬ 
offs  among  the  possible  training  variabloc. 

'"'Tile  methodology  presented  in  this  paper  visualises  tlie  problem  of 
cost  etfecti /enesR  in  tlie  following  ways:  First,  it  assumes  an  average 
level  traini.'tg  devwloper  who  may  or  may  not  be  aware  of  the  latest 
psychological  training  options  available  to  him  and  who  may  or  may  not 
be  aware  of  all  current  managerial  policies  that  .affect  his  choices, 
oecond,  it  assumes  tl»at  TKACOC  a.nd  tlio  training  manager  have  iJolicie.s 
which  they  expect  to  see  reflected  in  cost  and  operational  effectiveness 
analysis  (COFA)  decisions.  Third,  the  OOKA  analyst  may  or  may  not  have 
access  to  a  complete  Train  Up  Study  {TUS'  from  wl\ioh  to  refine  his  de¬ 
cisions.  Fourth,  he  is  probably  under  timo  pressure  to  supply  alternate 
programs  as  training  input  for  one  co«\ponent  of  a  convi'lete  COIA  analysis. 
Fifth,  ho  has  a  limited  numlier  of  supix>rt  personnel. 

Tlieao  constraints  imply  tlmt  a  decision  procedure  should  contain 
not  only  psychological  variables  but  managerial  and  technological  variables 
as  well,  hevertholess,  an  imi^ortant  in^int  is  that  a  COtlA  analyst  does 
not  have  to  explicitlv  consider  all  those  factors  himself  but  only  assure 
they  are  r'^janingfully  reflected  in  the  fin.il  decision  process.  Thus, 
the  developei  does  not  hvave  to  consider  each  facto*  if  the  meohat.ism  of 
the  decision  method  assures  that  tliey  weigh  in  the  final  outconxt.  If  a 
methodology  can  be  constructed  ''o  as  to  structmal iy  contain  the  i«\i'li- 
cations  of  previous  dacision.s,  they  tteed  not  again  Iv  considered  each  time 
a  new  analysis  is  performed.  The  work  involved  foi  <’ach  case  is  then  only 
the  detantiinat: on  of  which  variables  and  pMlicios  are  newly  applic.able. 

In  this  way,  an  increased  burden,  falls  onto  the  managers  because  they 
must  clearly  formulate  for  the  training  drv>5lopei-  wiial  policies  are  to  be 
iropiemtuitovi  and  what  their  expected  oi^'act  is  to  be.  hut  this  "burden" 
should  be  an  advaet.ige  to  the  nunager  in  that  it  will  assure  tliat  his 
iX'liciea  are  enacted. 

Ihe  crux  of  the  problem  then  is  how  t.^  develop  methodology  so  that 
it  links  decison  variables  explicitly  to  -ostable  aspects  of  training 
systems.  In  order  to  explore  this  issue  in  the  most  realistic  possible 
context,  the  present  methodoh^gica'.  development  was  linked  to  .an  ongoing 
COKA  which  was  being  eondneted  on  five  air  defense  systems,  one  of  which 
wa.s  the  AN/TSQ-71  mfs.sile  minder. 


Distinct  bounds  »rore  placed  on  the  scope  of  the  infonnation  to  be 
used,  first,  only  operations  occurring  in  the  AN/TSi^73  van  were  con¬ 
sidered.  Ihis  was  necessary  because  the  results  of  operator  actions 
taken  in  any  one  pare  of  a  complex  system  interact  with  all  other  areas. 

In  the  case  of  the  missile  minder,  tliis  would  have  meant  experimental 
analysis  ranging  from  remote  maintenance  facilities  to  grouisd/air  commu¬ 
nication  nets.  Such  a  massive  context  would  have  quickly  blurred  tJ»o 
research  focus.  Second,  two  MOS  categories  provided  student  populations 
for  the  25 (L)  MOS  which  was  costed  in  this  paper.  They  were  tlie  16J 
(system  operator)  and  14G  (command  and  cojjtrol  officer).  The  25 (L)  MOS 
is  somewhat  unusual  in  that,  it  blends  the  training  £.kills  of  a  system 
operator,  computer  operator,  etnd  maintenance  man  into  a  single  MOS.  Thus, 
although  tlie  analysis  was  confined  to  costing  this  MOS  and  determining  its 
training  requirements,  tlie  effort  nonetheless  encompassed  a  sufficiently 
wide  variety  of  skills  and  knowledge  to  insure  a  representative  samtUo. 

In  order  to  evaluate  the  immediate  usefulness  of  tlu>  motl»odology, 
it  was  decided  that  the  effort  would  address  the  s.ame  formal  requirements 
tl^at  were  stated  in  the  full  study  directive  for  the  training  COKA.  The 
COEA  study  directive  included  three  basic  training  rotiuirements .  They 
were : 

1.  Rank  order  alternate  training  proqratus  by  cost  effectiveness 
and  lecommend  a  course  of  action  for  each  alternative. 

2.  Determine  v,-hat  new  training  motluvls.  are  applicable  to  each 
alternative  system. 

.1.  Discover  what  test.,  are  requited  to  determine  the  effects  of 
different  levels  and  technique.^  of  training  in  the  selected 
system. 

Within  tl\e  limitations  mentioned  above,  tliose  objectives  were  -ret  in 
this  study  as  follows:  Fiist,  rank-onlerinq,  objective  nunJbor  l»w.'t.s 
answered  by  creating  a  ntothod  to  qenerate  an  alternate  training  ptwiram. 

All  of  the  five  systems  had  at  nwst  one  program,  and  funds  wore  not 
available  to  create  new  tr.'.’.ring  programs  to  serw  as  input  into  tl^e  COEA. 
This  was  in  part  because  no  crain-tip  study  was  available  when  the  [uo- 
^K)nent  was  tasked  with  producing  the  study  diiov'tive.  Also,  some  of 
the  systems  which  were  to  be  costed  existed  only  on  paper  and  actu.'il 
equipment  w.as  not  available.  Once  a  metliod  for  generating  such  an  alter¬ 
native  program  was  produced,  it  still  remained  to  cost  the  progr.im  in  ordei 
to  provide  a  comparison  with  appropriate  ixnt ions  of  the  existing  system. 
Ideally,  this  input  should  have  considered  every  factor  in  the  existing 
program.  Within  the  available  COEA  schedule,  tliis  w.as  not  possible. 

As  a  result,  the  AKl  input  constitutes  only  an  approximation  to  the  cost 
of  training  the  25(1.)  MOS. 


Objective  number  i.  «as  addressed  as  a  byproduct  of  objective  number  1* 
In  tite  course  of  performing  the  training  analysis ^  over  75  potential 
training  delivery  methods  were  considered*  Application  of  the  methodo.'.ogy 
reduced  this  set  to  18  which  were  applicable  for  training  the  25(L)  MOS. 
Their  names  are  given  in  Table  1.  They  are  described  in  Appendix  A  u'tder 
the  listed  paragraph  number.  For  manage .lal  reasons,  the  full  set  of  18 
was  not  costed  but  a  reduced  set  was  coaled  and  is  included  In  Appendix  C. 

Table  1 

TRAINING  METHODS  ACCEPTABLE  FOR  IMPLEMENTATION  IN  SELECTED  TASKS  OF 
THE  25(L)  MOS  IN  THE  Q-73  MISSILE  MINDER 

Name  of  Concept  Paragraph  Number  in  Appendix  A 


1  Case  study  folder  1 

2  Flash  cards  2 


3 

Performance  aids 

4 

4 

Reference  texts 

5 

5 

Reference  charts 

6 

6 

Self-scoring  exercises 

7 

7 

Dial  access-scheduled  audio 

9 

8 

Audio,  active  language  lab 

10 

9 

Radio  system  with  responders 

14 

10 

Filmstrip  projection 

16 

11 

Microform  mapping 

17 

12 

Microform  with  adjunct  equipment 

18 

13 

Dynamic  mock-ups 

19 

14 

Laboratory  carrel 

37 

15 

Branching  teaching  machine 

51 

16 

CAT  -  PLATO  IV 

64 

17 

CM  I 

66 

18 

Manual  simulation  game 

72 

Training  requirement  ni^er  3  was  highly  general  and  as  a  result,  it 
was  difficult  to  provide  specific  answers.  Once  a  COEA  methodology  is 
accepted,  the  in^Xications  for  validation  tests  will  fall  out  directly. 
Until  validation  tests  are  run,  all  methods  must  rely  on  tlie  current 
stats  of  art  in  transfer-of- training  predictions  and  will  have  a 
relatively  high  potential  for  error.  In  this  paper,  tlie  question  of 
effectiveness  depends  on  the  correctness  of  the  training  concept  selection 
matrix.  Ito  the  extent  that  the  matrix  predicts  high  transfer  of  training 
choices,  the  method  will  be  valid  for  cost  effectiveness  conclusions. 


METHOD 

The  method  used  in  this  study  is  encompassed  in  six  logical  stages: 

1.  Limits  on  available  transfer-of- training  technology  were  deter¬ 
mined  and  sources  of  Information  for  the  analytic  steps  were  identified. 

2>  The  tasV  environment  for  Q-73  operators  was  specified  In  terms 
of  variables  which  could  be  systematically  paired  to  costable  elements 
of  the  training  programs# 

3,  For  each  task  in  the  C~73  van,  three  alternate  methods  for  train¬ 
ing  that  task  were  determined.  This  required  the  creation  of  a  decision 
matrix  linking  tJ'.e  75  potential  training  mt?thods  to  55  psychological 
variedjles  used  to  describe  critical  training  characteristics  of  each  task. 

4,  The  large  set  of  training  device  selections  thus  generated  was 
condensed  into  a  smaller  set  cf  ti'aiiung  syvStems  which  took  into  account 
basic  managerial  and  cost  considerations  not  treated  in  the  pi*evious  stop, 

5.  Each  ccstable  Item  In  this  reduced  program  was  then  described  in 
dollar  values  along  37  variables  representing  seven  general  classes  of 
cost  information. 

6.  A  Navy  costing  program  Wv^s  modified  for  an  Army  IBM  system  360 
DCd  (disk  operating  system)  and  run.  The  output  provided  a  large  variety 
of  calculated  costing  information  that  was  usevi  by  decision  iiukers  in 
the  training  COEA.^ 


The  author  would  like  to  thank  Dr.  Richard  Braby  of  die  Naval  Training 
and  Evaluation  Group  (TAEG)  for  sup'plying  a  copy  of  the  Training 
Effectiveness,  Cost  Effectiveness  eicdiction  Program  (TECEP)  and  in 
giving  permission  to  reproduce  certain  material  fixim  TAEG  Rep«.iirt  #16, 

I  would  also  like  to  thank  Specialist  5  Nadeau  Jones  for  her  tielp  in 
p'rocossing  task  data  and  Mr.  Bob  Chalmers  of  the  US  Army  Air  Defense 
School  {USAAD.S)  for  supiplying  cost  figures  used  in  this  analysis. 


These  stages  will  now  be  considered  in  greater  detail.  Stage  one 
required  extensive  coordination  with  both  U5AADS  and  US  Army  TRADOC 
Systems  Analysis  Activity  (TRASANA)  ;.nd  was  accomplished  during  the 
period  when  the  study  plan  was  being  developed.  ARI  conducted  prelimi- 
n.'iry  literature  searches  on  a  wide  variety  of  sources.  After  taking 
in-o  account  availability,  docimentation,  practicality,  and  specialized 
Army  needs,  the  Navy  TECEPT  costing  approach  was  chosen  as  the  best 
potential  starting  point.  This  report  is  available  on  microfiche  from 
the  Defense  Documentation  Center  as  AD-A012  859  (A  Technique  for  Choosing 
Cost-Effective  Instructional  Delivery  Systems,  R.  Braby,  J.  M.  Henry,  and 
W.  F.  Parrish) . 

Stage  two  required  generation  of  a  selection  procedure  that  linked 
availad)ie  task  analysis  information  to  cost-able  elements  of  the  training 
program.  The  approach  used  a  55  by  75  cell  matrix.  Along  the  y  axis 
were  numbers  corresponding  to  paragraph  descriptions  of  psychological 
properties  such  as  reinforcement  schedule,  type  of  feedback,  sensory 
modality,  and  decision  making.  Along  the  x  axis  were  75  numbers  corres¬ 
ponding  to  potential  training  concepts  which  could  be  used  to  meer 
psychological  requirements  for  a  given  task.  These  included  such  items 
as  udcroform  mapping,  case  study  folders,  CAI  terminals,  and  branching 
texts.  The  complete  list  of  properties  a.nd  training  concepits  is  presented 
in  Appendix  A. 

The  values  for  each  cell  in  tlie  matrix  were  developed  as  follows. 

For  each  tiv.ining  concept,  three  independent  raters  Determined  whetlier 
each  of  the  55  psychological  variables  could  be  duplicated  by  the 
delivery  concept.  The  degree  to  which  each  vaiiable  could  be  applied 
was  broken  down  into  three  categories:  applicable  (A),  partially  appli¬ 
cable  (P),  not  applicable.  The  Uiree  ratings  for  each  concept  were  then 
logically  collapsed  across  rviters.  For  example,  if  tlie  three  ratings 
for  a  given  variable  were  A,A,P  or  A, A,  blank,  the  cell  value  in  the 
overall  matrix  was  coded  as  A.  Similar  rules  were  developed  for  each  of 
the  logical  combinations  of  rater  choices.  After  all  75  concepts  had  been 
evaluated  in  this  fashion,  the  ratings  were  plotted  in  tabular  form  in 
Uio  matrix  (Figure  1)  .  This  matrix  was  tlien  covered  with  a  plastic  sheet 
so  that  it  could  be  marked  on  and  be  reused  by  simply  wiping  the  matrix 
clean  with  a  cloth.  This  was  necessai'y  so  that  stage  three  could  be 
implemented. 

In  the  cnivd  stage,  each  of  219  tasks  (defined  by  task  description 
sheets  supplied  by  USAADS)  was  coded  in  terms  of  task  applicability  to 
each  of  the  55  psychological  variables.  Thus,  each  task  in  the  Q-73 
system  was  redefined  in  terms  of  the  same  set  of  variables  as  those 
used  to  define  the  training  concepts.  Tiiis  the.i  permitted  the  use  of 
the  matrix  as  a  selection  device.  For  each  task,  the  list  of  applicable 
psychological  variables  was  marked  in  grease  pencil  along  the  y  axis 
of  the  plastic-covered  matrix.  Tins  in  effect  defined  a  amcne  subset 
i'f  the  full  matrix  which  applieo  to  each  task.  For  e.ich  of  e  75 
training  concepts,  a  column  sum  w.it  made  by  counting  the  number  of  A's 


6 


which  were  applicable.  These  are  marked  at  the  Dottom  of  each  column  in 
the  picture  (Figure  2) .  Those  three  columns  with  the  highest  number  of 
applicable  psychological  varijibles  were  then  chosen  as  the  training  con¬ 
cepts  most  applicable  for  in^>leraenting  that  task.  In  case  of  ties,  the 
candidate  with  the  largest  number  of  partially  applicable  variables  (P*s) 
was  chosen.  The  top  three  concepts  were  then  tabulated  for  each  of  the 
219  tasks. 

In  the  fourth  stage,  these  lists  were  collapsed  to  facilitate  reduc¬ 
tion  into  a  cost-able  program.  Five  basic  criteria  were  used  in  this 
aggregation; 

1.  Practicality  for  the  Fort  Bliss  Air  Defense  School 

2.  Ixjgical  areas  of  task  type  as  defined  by  the  school 

3.  Number  of  tasks  which  could  be  taught  on  a  single  device 

4.  The  availability  of  information  on  the  training  concepts  for 
costing  and  transfer  of  training  estimations 

5.  The  approximate  percentage  of  time  occupied  by  each  task. 

Table  2  presents  this  reduced  program.  'n\e  training  concepts  are 
described  in  detail  in  Appendix  A.  From  this  set,  a  final  subset  was 
chosen  for  costing.  Because  of  the  unavailability  of  some  cost  data, 
the  final  set  was  redvjced  considerably.  Thus  a  large  degree  of  avail¬ 
able  precision  in  the  technique  was  not  used  in  the  final  stages.  Three 
components  were  costed  for  the  alternate  program: 

1.  Actual  equipment  used  four  pei’cent  of  the  17-week  training  course. 

2.  Reference  to.\ts,  classroom  aids,  and  branching  texts  used  45,2 
percent  of  the  time. 

3.  Mock-ups  with  nwvable  parts  and  selected  maintenance  functions 
used  50.8  percent  of  the  tin>e. 

In  stage  five,  each  roenber  in  this  i-edviced  set  was  costed  by  USAADS 
in  terirns  of  the  37  variables  shown  in  Appendix  B.  Some  of  this  infor¬ 
mation  was  imirediately  available,  some  had  to  be  inferred,  and  some  was 
classified  and  approxiiiu\tions  substituted  in  their  place. 

In  tlie  final  stage,  the  TECEPT  costing  pix>gram  was  nxedified  by  ARI 
to  permit  use  of  the  Army  360  Management  Information  Systems  Office  (MISO) 
at  Fort  Bliss.  Output  listings  are  provided  in  Appendi,\  C.  These  listings 
provide  the  ARI  content  input  for  the  COEA  study  directives.  They  repte-- 
sont  the  estimated  cost  of  one  alternative  training  program  fv'jr  the  35iL) 

MOS  as  it  applies  to  tasks  taking  pla.-e  in  the  Q-7i  van.  I'iu  1. sting  should 
be  interpreted  in  the  following  manner. 


Wttt»  «»eH  of  th«!  tUtfefe  oo»jiott%«fei  of  tho  twiftiog  tot  the 

rj(t>)  MOiS  ato  iistod  doi(tuoftti«liy  tn  the  aewe  fotrtet*  A  he«#,t  1» 
ptesentiil  ehowifti  vl»at  eenoept:  has  heett  Qostedli  followed  hy  a  petoeotage 
valwa  >rt\ioh  shows  the  approximate  awoimt  of  the  H'^ek-tlme  petted  to 
be  spent  using  the  eonoept^  tliis  Is  followed  by  a  list  of  costing 
vaciables  shewn  both  tn  life  cycle  fetw  and  in  ovetall  values*  together » 
they  comprise  the  Input  data  to  the  program*  this  listing  is  followed  hy 
similar  layout  for  the  calculated  infotmafeieu  for  that  component*  t1\e 
input /output  cycle  is  repeated  for  each  component*  because  costing 
experts  way  desire  to  weigh  each  component*a  dollar  use  on  a  baais  other 
than  time*  the  costed  data  for  each  component  is  treated  as  though  it 
constituted  the  entire  l7-wcek  program*  tiila  also  facilitates  variable 
comparisons  between  different  components  because  each  is  then  costed  on 
the  same  baais* 

iNollowittg  the  dOh<)Onent  inforswabion  is  «  eintle  page  showing  all  three 
components  eimultaneouely  and  t\\eir  dollar  costs  on  eight  key  decision 
variables*  After  this  sheet  are  a  series  of  twenti*  additional  variables 
which  could  be  considered*  'fliese  variables  are  all  tabulated  under  a 
single  column  labeled  method  I*  the  method  corresponds  to  an  additional 
feature  of  the  program  which  was  not  used.  It  is  possible  that  a  costing 
expert  ttv\y  be  Interested  in  variable  Interactions  under  different  sets  of 
assumptions.  Uecause  only  one  set  of  assuttgJbions  was  used  in  this  exer¬ 
cise,  ot\ly  one  eostl»\g  method  is  represented  in  tl\6  table.  As  hwuy  as 
eight  sets  are  |>0S8ibld, 

It  should  be  stressed  that  this  Input  is  not  Intended  as  a  final  pro* 
cKict  but  rather  as  an  illustration  of  tl\e  concrete  application  of  the 
methodology  to  a  recurring  regnirement  in  COlSA's.  It  is  anticipated  that 
USAADS  personnel  involved  in  fv\ture  COKA's  cm  use  this  tochnigvve  as  one 
way  of  providii\g  costed  alternatives  tor  TiyM)OC  COKA  reguiretkjnts.  In 
Its  present  state,  the  costing  portion  of  the  t\\ethodology  Is  ready  for 
immediate  application,  svibject  to  acceptance  of  tlie  variable  definitions 
In  Appendix  U.  Keflnoment  of  the  task  .tiualytic  portion  of  the  metl\odDlogy 
is  ongol^vg  and  will  also  bo  cosgnvtor  i«\i\iei'.vented. 

AN  KX/\MPUi  '*t5KNKRA’l'U  A  Sl'l'K  ADAP'VKO  'I'APd" 

iV)  llivjstratr  the  imi)lementation  of  this  pi\‘>ccdure,  an  ex.aiwiJle  of 
how  one  task  sheet  was  coded  is  gi\*eJ\  below.  Plgnre  3  sliows  a  typical 
task  sheet  svippiied  by  USAADS,  The  aver.age  task  sheet  InclvKles  four 
sources  of  information.  It  consivlors  skills,  attitudes,  and  knowledges 
as  well  as  secondary  dat.a—svicU  as  rofer*»nco8  to  uvore  detailed  descrip¬ 
tions  of  the  tasks,  the  .tpp»x>ximate  a\i>ount  of  tlute  spent  ii\  performing 
the  task,  and  the  relation  the  t.ask  h.as  to  similar  Jobs  in  tl\e 
system.  Tj\ble  3  shows  how  this  particular  task  sheet  was  evaluated.  It 
is  pi^eseivted  in  terms  of  the  task  .appiopriate  members  of  tl»e  SS  psycholog¬ 
ical  variables  shown  in  Appendix  A.  These  selected  varli^bles  wei'e  then 
t.iarked  oi\  the  selection  mtrlx  by  tows  (See  t'igure  2).  Next,  each  column 
was  sumttKjd  by  .adding  the  cell  values  for  e,ach  applicable  psychological 
variable.  The  tltree  largest  svuws  were  U\en  clvosen.  They  cori'esi\M\ded  io 
the  three  delivery  system  coUunu  iniul'st's  best  suited  for  this  p.vrticular 
task.  'I'ltey  werei 
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This  ci)eration  was  repeated  for  all  task  sheets  in  the  25  (t)  MOS. 
Betause  this  resulted  in  219  sets  of  possible  costing  selections,  it  was 
netessary  to  collapse  those  alternatives  into  smaller  sets  for  detailed 
considetation  by  costing  experts.  This  reduction  followed  the  procedures 
set  forth  earlier  and  resulted  in  tlie  program  shown  in  Table  2.  The 
reduction  produced  ten  concepts  as  candidates  for  different  components 
Of  ty^e  training  program.  They  are  described  in  Appendix  A  by  number, 
t'row  these  ton,  the  final  program  was  reduced  to  the  three  actually  listed 
because  of  cost  information  availability  and  managerial  requirements  be¬ 
yond  the  control  of  ARI. 
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Standard  Job  taak  condition  lovol  1. 

Incwabant  utoa  DTK  S^lASOoftSl^lA^  cbaptor  A»  DTK  $*1A23'‘650'‘12* 


JC&  •rANOAMO 

CS]  i»uaLUHca  O  otntVKO  Q  iMnuco 

DTK  9-l430*b5l*l9,  para  A-16  and  A-U,  and  table  4»U» 

An  txptrUnced  nan  can  parform  thla  taak  In  5  Mlnutac  or  laaa. 


sui*i>enTiNO  sKiLWt  ano  Knowttooci 

SOl«  Ba  able  to  uaa  the  keyboard  printer  unit  to  enter  coaputcr  eodea  and  program 
format a, 

502,  Be  able  to,  physically  mount  and  dismount  program  tapes  on  magnetic  tape  unit 

(irru). 

503,  Be  able  to  logically  mount  and  dismount  tapes  on  magnetic  tape  unit  (KTU). 

504.  Be  able  to  read  keyboard  printer  unit  output  to  determine  succeeding  actions 

roquired. 

505.  Be  able  to  take  actions  specified  by  the  computer  printout  and  enter  required 
data  via  the  keyboard  printer  unit. 

S06t  Be  able  to  recognite  fault  detection  codes  on  the  ADP  atatue  and  control  panel, 

507,  Be  able  to  dlacrimlnate  between  normal  end  abnormal  program  antry  printout  indi* 

cations, 

508.  Be  able  to  Identify  the  master  tape  from  a  site  adapted  tape. 

KOI,  lh\ow  when  master  program  changes  are  necessary  for  site  adaptation. 

KO!l.  Know  uhen  to  Initiate  off-line  Initialisation  procedure  for  entering  aita- 
fidapted  data. 


ATTtruoKa 

1.  Be  aware  that  when  mounting  a  tape*  care  nuat  be  taken  not  to  pinch  fingert 
batwean  tape  cartridge  and  the  megnetloitape  unit. 

2.  Be  awere  that  normal  indications  change  vary  rapidly  on  the  ADP. 


Figure  5,  Typical  task  data  sheet 
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SEUECfRP  PSYCHOIOOICA^  VAXIAEI.ES  A-W  USAGE  RATIONAtE 


Alf/K{}“?3  Syttttm  Op*r«tor/R«p«ir««n 

-'TASK}  Sy*{«B  Initlaltoitton 

#8.3  om  OSAADS  TtAk  Mvt  for  the  250.)  HOS 


Th«  *!t*u«ptloni  during  ««ch  selection  are  presented  In  the  following 
First ,  the  nunber  of  the  psychological  characteristic  and 
dasqrlptton  given  In  Appendix  Ai  second »  a  title  identifier;  third, 
the' choice  rationale, 

i.  Visual  Alnhanutwrle  -  selected  because  task  Involves; 

a,  Uaage  of  alphanumeric  eleaents  on  eoaputer  keyboard 

b,  Computer  codes  and  foraats 

c,  Fault  detection  codes  and  Indicators 

Visual  O^lecta  -  selected  because  a  real  3-D  object  nay  bo  used  as 
the  training  device.  For  exanple,  the  keyboard  printer  nay  be  needed. 

Visual  Still  -  selected  because  task  Involves  usage  of: 

a,  DMT 

b,  Conputar  printout 

10,  Black  and  White  Visual  Field  -  selected  because  task  involves  usage 
'oft 

a,  Elenents  on  keyboard 
bt  Conputer  printout 
,c,  DMT 

13,  Exact  Seale  fone-to-one  sK>ck-upa)  -  selected  because  such  objects  nay 
be  ised  a#  actual  training  devices, 

U,  Proportional  Scale  -  selected  because  such  devices  say  be  used  for: 

a.  Briefings 

b,  Denonat rat Iona 

c.  Actual  training  devices 

d,  Kavlewlng  and  testing 

18,  Tsetile  Cues  -  (signals  received  through  the  sense  of  touch)  - 
selected  of  Its  usefulness  In  learning  to  operate  the  conputer  keyboard, 

19,  Internal  Stlnulus  -  selected  because  of  Internel  sensations  fnlt 
vhtn  error  le  nede  (exanple:  when  wrong  key  Is  punched  on  keyboard 
printer,  It  Is  ssnsed), 

22,  Multiple  Choice  -  selected  becauae  this  task  Involvea  decision 

SMking, 

27,  Manipulative  Acta  -  eelectod  becauae  this  teak  Involves: 

a.  Mounting  and  dlsnounting  tapes 

b.  Operating  keyboard 

c.  Turning  switches  on  and  off 

30,  Procedural  Manipulative  Acts  -  selected  becauee  sequential  atepa 
are  hwolved  In  the  operation  of  this  task, 

32,  35,  4  39,  Feedback  -  eelected  because  fault  and  normal  Indicators 
provide  trainee  with  immediate  and  continuous  content  feedback, 

45,  Automatic  Sequenclnx  and  Pacing  -  selected  because; 

a,  trainee  must  remain  alert 

b.  trainee  must  remain  at  the  threshold  level  of  his  ability  to 
learn 

48.  Dynamic  Modeling  (simulation  model)  ~  selected  becauae  glmulated 
models  may  be  used  for; 

a.  Practical  exercises 

b.  Tral.ilug  and  testing  devices 
c>  Illustrating  and  reviewing 

49.  Fixed  Study  Position  (location)  -  selected  as  relevant  because 
equipment  for  such  a  task  is  usually  in  a  fixed  location. 


appe^;dix  a 

PSYCHOLOGICAL  VARIABLES  AND  TRAINING  CONCEPTS 

Included  in  this  section  are  the  psychological  variables  numbered 
1-55  followed  by  the  training  concepts  labeled  1-75.  Thus  if  the 
sample  program  sheet  calls  for  concept  19,  it  is  referencing  a  dynamic 
mock-up  Including  panels  and  demonstrators.  If  the  example  task 
references  variable  16,  it  is  referring  to  an  audio  property  having 
the  capability  of  full  frequency  reproduction. 


PSYCHOLOGICAL  VARIABLES 


STimUS  CAPABILITIES 
Visual  Poftn 

1.  Visual  Alphanumeric  -  words,  numbers  and  other  symbols  presented  graph- 
leally. 

Visual  Pictorial,  Plane  -  a  two-dimensional  image,  a  representation  is 
the  form  of  a  photograph  or  drawing. 

Visual  Line  Construction,  Plane  -  a  two-dimensional  figure  made  of 
lines,  such  as  a  mathematical  curve  or  graph. 

Visual  Ob'‘,o.ct,  olid  -  a  three-dimensional  image  or  reality  that  is 
viewed  from  exterior  perspectives. 

Visual  Environment  -  a  three-dimensional  image  or  reality  tnat  is 
viewed  from  inside. 

Visual  Movement 

Visual  Still  -  a  static  visual  field,  as  with  a  still  photograph,  draw¬ 
ing  or  printed  page. 

7.  Visual  Limited  Movement  -  a  basically  static  visual  field  with  elements 
that  can  be  made  to  move,  as  with  an  animated  transparency  or  simple 
panel  with  switches  that  move. 

8.  Vistial  Full  Movement  -  a  visual  field  in  v;hlch  all  elements  can  move, 
as  with  a  motion  picture,  flight  simulator,  or  operational  aircraft. 

9.  Visual  Cyclic  Movement  -  a  visual  field  which  moves  through  a  fixed 
sequence  and  then  repeats  the  sequence  in  a  repetitive  manner,  os  with 
a  film  loop. 

Visual  Spectrum 

Black  and  White  -  a  visual  field  composed  of  either  black  ov  white 
elements,  as  with  the  printed  page  or  line  drawings. 

■  Cray  Scale  -  a  visual  field  composed  of  black,  white  and  continuous 

gradations  of  gray,  as  with  a  black  and  white  photograph  or  television 
picture. 


Visual  Spcctruffi  (continued) 

12.  Color  -  a  visual  field  composed  of  various  segments«of  the  visual 
spectrum,  as  with  color  television  or  motion  pictures. 

Scale 


13.  Exact  Scale  -  actual  visual  field  or  a  one-to-one  replication  of  that 
field  as  with  a  full-sized  mock-up,  simulator,  or  operational  system. 

lA.  Proportional  Scale  -  a  repreaeittation  of  reality  in  other  than  full 
scale,  such  as  a  scaled  model  map  or  photograph. 


Audio 


15.  Voice  Sound  Range  -  a  limited  quality  of  sound  which  enables  spoken 
words  to  be  used  as  the  medium  of  communications,  but  not  suited  to 
more  demanding  tasks,  such  as  music  or  sound  recognition  exercises. 

16.  Full  Sound  Range  -  a  quality  of  sound  reproduction  that  contains  all 
the  significant  elements  of  the  sound  and  is  suited  to  the  demanding 
task  of  sound  recognition  exercises. 

17.  /Vroblent  Sounds  -a  complex  sound  environment  with  sounds  emanating  from 
various  sources  and  from  various  directions,  including  background 
noise  and  task  significant  sounds. 


Other 

18.  Tactile  Cues  -  signals  received  through  the  sense  of  touch,  including 
sensations  related  to  texture,  size  or  shape, 

19.  Internal  Stimulus  Motion  Cues  -  the  sensations  felt  by  a  person  when 
he  moves  his  am\,  leg,  fingers,  etc. 

20.  External  Stimulus  Motion  Cues  -  the  sensations  felt  by  a  person  when 
he  is  moved  by  some  outside  force  in  such  a  way  that  his  body  experi¬ 
ences  roll,  pitch,  yaw,  heave,  sway  and/or  surge. 

TRAINEE  RESPONSE  MODES 

21.  Covert  Response  -  a  response  which  the  trainee  creates  in  his  mind  but 
does  not  express  in  an  observable  manner. 

22.  Multiple  Choice  -  a  response  mode  in  which  a  trainee  selects  a  response 
from  a  limited  set  of  responses. 
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TRAINEE  RESPONSE  MODES  (continued) 


23.  Pre-proRrammad  Verbal  PerFox'mance  ~  a  response  mode  in  which  a  trainee 
creates  a  short  answer  to  a  question  having  a  limited  set  of  correct 
answers. 

24.  Frec-Stvlc  Written  Performance  -a  response  mode  in  which  a  trainee 
writes  a  response  in  his  own  wnrds. 

25.  Pecisiv^n  Indicator  -  a  verbal  or  perceptual  motor  response  in  which  the 
trainee  indicates  that  he  has  made  a  divergent  type  decision. 

26.  Voice  PorCormance  -  a  response  mode  in  which  a  trainee  speaks,  including 
conversation. 

27.  Fine  Movement  Manipulative  Acts  -  a  response  mode  in  which  a  trainee 
makes  discreet  ai^d  small  movements  of  diaio,  switches,  keys  or  makes 
sensitive  adjustments  to  instruments.  Act  may  involve  use  of  small 
instruments. 

28.  Broad  Movement  Manipulative  Acts  ~  a  rei ponse  mode  in  which  a  trainee 
makes  large  movements  of  levers  or  wheels  on  large  pieces  of  equipment 
or  by  the  use  of  hand  held  tools. 

29.  Tracking  -  a  response  mode  in  which  a  trainee  continuously  controls  h 
constantly  changing  system,  such  as  steering  an  automobile  or  holding  a 
compass  bearing  in  steering  a  ship. 

Procedural  Manipulative  Acts  -  a  response  mode  in  which  a  trainee  per- 
foois  the  sequence  of  steps  in  a  procedure,  such  as  in  the  carrying  out 
of  the  items  on  the  checklist  for  pre-flight ing  an  aircraft 'or  turning 
on  a  radar  system. 

INFORMiiTION  FEEDBACK  LOGIC 

Form  of  Feedback 


31.  Intrinsic  Feedback  -  information  the  trainee  receives  from  his  own 
internal  movements  or  from  proprioceptive  stimulation. 

32.  Action  Feedback  -  externally’  displayed  cues  inherent  in  the  task,  in- 

luding  such  fora\s  as  instrviment  indications  and  the  display  of  answers 
to  questions  as  in  linear  progranmied  instruction. 

Augment t‘d  Feedback  -  immediate  presentation  of  information  to  the  trainee 
on  how  the  results  of  his  periormance  conform  to  some  crito;ion  or  an 
objective  reference. 
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Form  of  Feedback  (continued) 

34.  Reconstruction  Feedback  -  critical  analysis  or  evaluation  of  trainee 
performance^  usually  at  the  completion  of  an  exercise  or  a  significant 
block  of  instruction. 

Content  of  Feedback 

35.  Correct  Response  Data  -  an  indication  of  correct  response  is  provided 
the  trainee  either  irnnediately  after  he  responds  or  automatically  in 
the  event  he  does  not  respond  within  a  specified  time. 

36.  Score  Date  -  the  trainee  receives  quantitative  infonoation  about  his 
performance  (such  as  amount,  percent  and  rate  date). 

37.  Diagnostic  Data  -  the  trainee  is  informed  of  inadequate  performance, 
its  cause,  and  prescribed  remedial  actions. 

38.  System  Performance  Data  -  the  trainee  observes  changes  in  the  state  of 
a  system  as  a  consequence  of  his  actions  in  the  system. 

Time  Schedule  for  Feedback 

39.  Immediate  -  feedback  provided  in  continuity  with  a  trainee's  action, 
either  continuously  as  accrued  or  at  the  conclusion  of  each  student 
response. 

40.  Fixed  -  feedback  provided  to  the  trainee  at  prescribed  times,  such  as 
at  the  end  of  an  exercise  or  at  timed  intervals. 

41.  Variable  -  feedback  provided  to  a  trainee  according  to  a  variable 
schedule  which  may  change  as  a  function  of  stage  of  training  or  level 
of  performance.  This  includes  the  provision  for  intermittent  presenta¬ 
tions  to  permit  probabilistic  schedules  of  reinforcement. 

EVENT  SEQUENCE  LOGIC 

42.  Linear  -  a  fixed  sequence  of  instructional  events,  as  in  linear  pro¬ 
grammed  Instruction  and  motion  pictures. 

^3.  Cyclic  -  a  special  case  of  linear  sequence  in  which  a  limited  s<jgment 
of  a  linear  program  is  repeated  continuously  throughout  a  period  of 
time,  as  with  a  film  loop. 

44.  Brimch(ng  -  a  sequencing  of  instructional  events  with  the  trainee 
routed  to  appropriate  advanced  or  remedial  material  based  upon  his 
answers  to  diagnostic  questions  imbedded  at  intervals  in  ihe  material. 
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EVENT  SEQUENCE  LOGIC  (continued) 

^5.  Automated  (Machine)  Adaptive  ~  an  automatic  sequencing  and  pacing  of 

events  designed  to  Veep  a  trainee  at  the  threshold  level  of  his  ability 
to  learn  at  all  times. 

Instructor  Selected  Sequence  -  the  ordering  of  events  by  the  instructor, 
such  as  in  a  lecture-recitation  period  in  the  traditional  classroom  or 
in  tutoring. 

A7.  Trainee-Initiated  Inquiry  -  the  selection,  sequencing  and  pacing  of 
learning  events  by  the  trainee. 

Dynamic  Modeling  -  system  programming  In  the  form  of  a  simulation  model 
which  cnnblos  the  trainee  to  exercise  the  model  and  observe  the  cor¬ 
responding  effects. 

INSTRUCTIONAL  SETTING 

Individual  Trainee  at  Fixed  Location  -  a  fixed  study  position  for 
individualized  instruction,  such  as  in  a  school  with  carrels  or  CAI. 
terminals, 

50.  Individual  Trainees  with  Simultaneous  Instruction  at  Many  Locations  - 
any  site  that  can  be  used  with  a  tclccoinmunicatlon  mode  of  instruction, 
as  with  scheduled  radio  or  broadcast  television. 

51,  Individual  Trainee  with  Independent  Instruction  at  Any  Location  -  r  '.y 
sice  that  can  be  used  by  a  student  for  Independent  study  as  with  books 
or  programmed  instruction  texts. 

Small  Group  -  a  meeting  site  accommodating  up  to  15  people,  enabling 
small  group  dynamics  to  function;  both  leader less  and  leader-directed 
groups;  a  small  classroom, 

53.  Large  Croup  at  Single  Location  -  a  meeting  site  for  more  than  15  people, 
such  as  a  large  classroom  or  auditorium. 

5^*  Largo  Groups  at  Dispersed  Locations  -  t\x>  or  more  group  meeting  sites 
that  can  be  linked  with  communication  equipment  for  a  common  training 
program,  as  with  two-way  closed  circuit  TV  between  classrooms  at  two 
different  schools. 

55.  Team  Setting  -  a  single  site  that  la  equipped  to  enable  a  group  of 
individuals  to  perform  as  a  team,  as  in  a  weapon  system  simulator  or 
operational  system. 


TRAINING  CONCEPTS 


Print  Moterials 


1.  Case  Study  Folder  -  A  folder  of  detailed  background  information  on 
a  problem  requiring  a  decision  or  pl?n  of  action;  to  be  read  by  the 
trainee  prior  to  his  (1)  making  a  decision  on  how  to  resolve  the 
issue  and  (2)  participating  in  a  critique  on  various  solutions. 

Flash  Cards  -  A  set  of  cards  designed  to  be  used  by  an  instructor  in 
front  of  a  group  of  trainees  to  drill  the  group  in  the  recall  of 
memory  type  information. 

3.  Printed  Materials  -  Handouts  -  Handouts  are  a  class  of  printed 
materials  issued  to  a  student  for  his  use  and  retention  to  augment 
regul.ar  instructional  materials.  They  are  usually  instructor  pre¬ 
pared,  machine  copied  materials  of  one  or  two  pages  highlighting 
specific  topics  or  updating  existing  materials. 

4.  Printed  Materials  ~  Performance  Aids  -  Performance  aids  are  a  class 
of  printed  materials  that  aid  in  job  performance  by  providing  data 
that  should  not  be  committed  to  memory.  They  include  checklist 
routines,  conversion  tables,  equipment  test  tolerance  matrices  and 
the  like. 

5.  Printed  Materials  --  Reference  Books  -  Reference  books  are  a  class  of 
printed  materials  used  to  Identify  certain  facts  or  for  background 
information  such  as  dictionaries,  encyclopedias  or  technical  publica¬ 
tions. 

Printed  Materials  -  Reference  Charts  -  Reference  charts  are  a  class 
of  printed  material  pictorially  displaying  data  used  to  identify 
certain  facts  or  for  background  information.  Included  are  data 
charts,  schematic  diagrams,  topographical  maps  and  the  like. 

Printed  Materials  -  Self-Scoring  Exercises  -  Self-scoring  materials 
include  exercises  and  quizzes  used  in  conjunction  with  standard 
curriculum,  or  programmed  Instruction.  The  class  includes  electro¬ 
graphic  or  mark  sense  materials  scored  by  keys  or  computer,  punch 
mark  and  other  mechanical  score  indicating  equipments,  chemically 
scored  materials,  etc.,  that  have  the  capability  of  providing  near 
inmiediate  stude.\t  feedback  without  the  use  of  prolonged  scoring 
procedurer . 

d.  Did  Access  Information  Retrieval  System  -  Random  Atutio  -  Dial  access 
information  retrieval  is  an  electronic  system  for  distributing  audio 
(and /or  visual)  materials  and  programs  which  are  stored  in  a  location 


remote  from  where  they  are  dialed  and  received.  Random  audio  means 
that  audio  materials  are  retrievable  at  any  time  by  electronically 
triggering  a  tape  duplicating  machine  that  makes  a  student  copy  from 
a  master  tape  within  the  library. 

9.  Dial  Access  Information  Retrieval  System  -  Scheduled  Audio  -  Scheduled 
audio  means  that  audio  materials  may  be  dialed  at  any  time,  but  once  a 
program  has  begun,  subsequent  users  must  join  the  program  in  progress. 

10.  Language  Laboratory  -  Audio,  Active  -  Compare  Mode  -  An  audio  presenta¬ 
tional  device  that  distributes  audio  information  via  a  control  console 
to  student  stations  equipped  with  headsets,  microphone  for  console/ 
instructor-student  Inter-communicatlon,  and  a  tape  recorder.  Student 
may  interact  with  taped  instructional  material,  rewind  and  play  back 

or  store  responses.  Student  responses  may  be  monitored  or  recorded 
at  console. 

11.  Language  Laboratory  -  Audio  Passive  Mode  -  An  audio  presentational 
device  that  distributes  audio  Infoimatlon  from  a  control  console  to 
student  stations  equipped  with  headsets.  Audio  source  may  be  a  phono¬ 
graph  record,  a  taped  recording,  or  a  motion  picture  sound  track. 

12.  Physiological  Trainer  (Hostile  Environment)  Auditory  -  A  training 
device  designed  to  place  controlled  stress  on  the  human  hearing  system 
through  use  of  a  physiologically  and/or  psychologically  adverse  sound 
environment,  to  enable  a  trainee  to  learn  to  function  in  this  adverse 
environment . 

13.  Radio  System  -  A>M/FM  -  A  passive  audio  system  consisting  of  a  broad¬ 
cast  studio,  transmitting  station,  and  student  radio  receivers.  The 
system  uses  designated  AM/FM  frequency  hands  for  information  trans¬ 
mission. 

i'i.  Radio  .System  with  Responders  -  A  multi-channel  two-way  radio  communica¬ 
tion  system  that  operates  within  UHF  or  VHF-FM  frequency  bands  limiting 
broadcast  ranges.  Network  may  be  open  or  use  cncoding/decoclinj.>  tech¬ 
niques  or  responders  for  individual  channel  privacy. 

15.  TolepUono  Conference  System  -  A  telephone  system  with  switching  matrix 
capability  that  allows  multiple  station  two-way  audio  communication  at 
two  or  more  remote  locations. 

Visual  Only  Systems 

16.  Filmstrip  Projection  System  -  A  single  frame  projector  or  attachment 
thereto  that  will  accept  a  filmstrip  format  and  project  the  film 
images  upon  a  viewing  screen.  See:  Sound  Filmstrip  Projection  System. 

Microform  with  Information  Mapping  -  Nlcroimagery ,  such  as  microfilm, 
used  as  a  medium  of  instruction  with  the  additional  requirement  that 


each  block  of  information  be  clearly  identified  as  introduction, 
overview,  test,  review  questions,  index  and  other  discrete  titles, 
and  that  each  type  of  information  be  positioned  in  a  standard 
location  within  the  medium  format. 

1®*  Microform  with  Information  Mapping  and  Adjunct  Equipment  -  The 
theoretical  configuration  of  a  training  system  to  support  indi¬ 
vidualized  instruction  composed  of  microimagery  in  an  information 
map  format,  a  microform  reader,  and  a  piece  of  auxiliary  equipment, 
such  as  a  mock-up,  which  is  the  subject  of  the  Instruction. 

19.  Mock-ups,  Panels,  and  Demonstrators  -  Dynamic  -  A  visual  training 
aid  that  allows  an  Instructor  to  demonstrate  manipulative  princi¬ 
ple,  movement  in  time  or  space,  steps  of  a  procedure,  linear 
effect  within  systems  or  changes  in  condition  of  equipment  or 
systems  through  one  or  more  operating  phases. 

20.  Models  and  Static  Mock-ups  -  Small  Scale  -  A  three-dimensional 
training  aid  built  to  scale  and  representing  operational  equipment. 
It  may  be  a  solid  or  cutaway  model  capable  of  disassembly  by  which 
spatial  and/or  sequential  relationships  are  represented.  Also 
Included  are  layout  models,  recognition  model  sets,  and  terrain  or 
topographical  models. 

21.  Mock-ups,  Panels  and  Demonstrators  -  Static  -  A  training  aid  used 
to  demonstrate  relative  shape,  size,  composition  or  function  of  an 
object  or  system  by  a  visual-cognitive  process  performed  by  the 
trainee.  Such  non-moving,  real  or  "scaled"  aids  include  cutaway 
models,  diagrams,  blow-apart  hardware  displays,  etc. 

22.  Slide  Projector  System  -  2"  x  2"  -  A  class  of  single  frame  picture 
projectors  that  will  accept  a  standard  2"  x  2"  slide  and  project 
the  contained  image  upon  a  viewing  screen. 

23.  Printed  Material  -  Workbook  -  Workbooks  are  a  class  of  printed 
material  used  to  augment  or  replace  instructional  texts  by  pro¬ 
viding  a  mix  of  text  Information  and  practice  exercises  within  a 
single  book  or  manual. 

2A.  Printed  Material  -  Textbook  -  Textbooks  are  a  class  of  printed 
material  dealing  with  a  subject  of  study,  intended  for  use  at  a 
specified  level  of  Instruction  and  used  as  a  principal  source  of 
organized  information. 

25.  Programmed  Text  -  Branching  -  A  printed  text  containing  frames  of 
information  and  multiple  choice  questions  concerning  the  informa¬ 
tion,  organized  in  such  a  way  that  the  trainee's  choice  of  response 
directs  him  to  remedial  frames  or  advanced  material,  as  appro¬ 
priate.  The  material  is  carefully  sequenced,  tested  and  revised 


to  ensure  that  a  spe9l£lc  student  population  will  achieve  stated 
behavioral  objectives  with  a  predetermined  level  of  success • 

26.  Progratnmed  Text  -  Branching  with  Adjunct  Material/Equipment  -  A 
form  of  program  in  which  additional  materials  such  as  drawings, 
catalogues,  or  equipment  are  used  with  the  regular  branching  pro¬ 
grammed  text. 

27.  Programmed  Text  -  Linear  -  A  printed  text  containing  a  fixed 
sequence  of  small  frames  of  Information  usually  in  the  form  of 
questions  requiring  the  trainee  to  construct  a  simple  written 
response,  which  is  immediately  evaluated.  The  material  is  care¬ 
fully  sequenced,  tested,  and  revised  to  ensure  that  a  specific 
student  population  will  achieve  stated  behavioral  objectives  with 
a  predetermined  level  of  success. 

28.  Programmed  Text  -  Linear  with  Adjunct  Material/Equipment  -  A  form 
of  program  in  which  additional  material  such  as  drawings,  cata¬ 
logues,  or  equipment  are  used  with  the  regular  linear  progranned 
text. 

•» 

29.  Study  Card  Sets  -  A  deck  or  decks  of  cards  designed  tr  present 
training  information  to  an  individual  student. 

Audio  Only  Systems 

Ahdio  Disc  Playback  System  -  An  audio  system  that  uses  a  record 
player  and  sound  recorded  on  a  disc  (record)  that  may  be  played 
back  by  a  listener. 

Audio  Tape  System  -  An  audio  system  that  uses  a  tape  recorder/ 
reproducer  to  record  sound  on  magnetic  tape  that  may  be  played 
back  upon  request  by  a  listener. 

32.  Simulation  -  Paper  -  The  representation  of  selected  dynamic 
characteristics  of  a  system  through  the  use  of  charts,  tables, 
static  photographs,  drawings,  and  lists  of  performance  character¬ 
istics  under  specified  conditions.  This  information  is  presented 
in  such  a  way  that  the  trainee  can  study  the  initial  performance 
of  the  Fystem,  change  inputs  to  or  elements  within  the  system  and 
note  changes  in  the  performance  of  the  system. 

leaching  Machine  -  Linear,  Still  Visual  -  An  individualized  instruc¬ 
tion  system  composed  of  a  fixed  linear  sequence  of  small  step  pro¬ 
grammed  instruction  frames  (still)  and  a  manually  controlled  device 
to  display  the  information. 

3^.  Igacljlng  Machine  -  Branching.  Still  VlsuaJL  -  An  individualized 

instrucUon  system  composed  of  large  step  multiple  choice  programmed 
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iniitruction  frames  (still)  anct  a  manually  controlled  device  to 
select »  sequence  and  display  program  frames  in  an  order  dependent 
upon  the  trainee's  last  response. 

Audio-Visual  Systems 

35.  Audio  Tape  with  Printed  Material  -  An  audio  system  that  uses  a  tape 
recorder/ reproducer  to  record  sound  on  magnetic  tape  that  may  be 
played  back  upon  request.  Printed  materials  such  as  texts >  work¬ 
sheets,  PI,  schematics,  test  materials,  etc.,  used  with  audio  tapes 
offer  a  variety  of  training  applications. 

Carrel  -  AV  Equipped  -  A  smal]  enclosure  or  alcove  incorporating  a 
desk  used  for  individual  studies,  supplied  with  audio  and  visual 
materials  and  supporting  equipment. 

37,  Carrel  -  Laboratory  -  A  small  enclosure  or  alcove  incorporating  a 
desk,  to  be  used  by  one  or  two  trainees  and  equipped  with  a  set  of 
special  tools  and  material  for  carrying  out  a  hands-on  learning 
event.  It  may  include  audio-visual  systems. 

38*  Dial  Access  Information  Retrieval  System  -  Scheduled  Audio/Video  - 
Dial  access  information  retrieval  is  an  electronic  system  for  dis¬ 
tributing  audio  and  visual  materials  and  programs  which  are  stored 
in  a  location  remote  from  where  they  are  dialed  and  received. 
Scheduled  audio/video  means  that  presentations  are  retrievable  at 
any  time  except  that  once  a  program  has  begun,  subsequent  users 
must  join  the  program  in  progress. 

39.  Filmstrip  Projection  System  with  Audio  -  A  sound  filmstrip  projector 
represents  a  family  of  audio-visual  devices  using  single  frame 
visus*  filmstrips  with  sound  on  magnetic  tape  or  records.  Visuals 
and  sound  may  be  manually  or  automatically  synchronized.  Commercial 
equipment  options  include  front  or  rear  screen  proj’ection,  remote 
and  stop  action  capability,  and  cartridge  loading  models. 

AO.  Filmstrip  Projection  System  with  Audio  and  Adjunct  Equipment  -  A 
system  for  presenting  Information  via  a  filmstrip  projector  and 
synchronized  audio  tape  and  special  equipment  that  is  the  subject 
of  study.  The  use  of  adjunct  equipment  with  the  AV  media  provides 
the  capability  for  a  variety  of  "hands-on"  training  tasks  to  be 
performed. 

^1*  Instructional  Kit  with  Instructor  -  A  teaching  kit  designed  for 

specific  subject  area  Instructional  support.  Kit  allows  the  instruc¬ 
tor  to  use  a  varied  or  multi-level  teaching  approach  to  Instruction 
by  Including  appropriate  visual  aids,  audio  tapes,  models,  charts, 
demonstrators,  reference  and  test  materials. 


Instructional  Kttn  fey  ttatnaea  -  A  inodular  packaia  of  wateriala 
for  atudonta  that  containi  a VI  matariala  raquirad  for  a  aagmant  of 
instruction.  Kit  may  contain  prograMnad  instruction,  audio»visual 
matarials,  tools,  taatarialn,  typical  samplas,  rafaranca  matarials 
and  testing  matarials  as  appropriata. 


Hotion  Picture  Frojacr.ion  system  -  Gommarciai,  lotiM  ana  super  omm 
Films  «  A  motion  picture  projaction  system  implying  the  use  of  pro'^ 
fassionally  prapatad  l6sn  or  S<43mm  sound  motion  picture  films  for 
training.^  Appropriate  16im  or  S-Sma  projector  and  projection  screen 
are  included. 

Motion  Picture  Projection  System  -  Lov  Budget  16MM  and  Super  8HM 
Wlwa  -  A  motion"  picture  projaction  sVs^^^^  of 

locally  produced  sound  motion  picture  films  for  training.  Such 
films  are  acceptable  for  training,  but  often  lack  the  professional 
quality  of  commercial  films.  Appropriate  16mm  or  S-Smm  projector 
and  projection  8cree.i  are  Included. 

t 

Microform  vlth  Information  Mapping,  and  Audio  -  The  theoretical 
configuration  of  a  training  system  to  support  individualised  instruc* 
tlon  composed  of  mlcrolmagary  in  m  information  map  format,  a  micro* 
form  reader,  an  audio  tape  in  a  cassette  and  an  audio  cassette  play* 
back  unit. 

Overhead  Projection  System  vith  Instructor  -  A  system  consisting  of 
a  horisontal  stage  projector  designed  Vo  u^e  a  vertical  throw  for 
focusing  an  enlarged  transparency  image  upon  a  projection  screen. 

An  operator  is  normally  required  to  change  the  transparency  and  s 
furnish  verbal  commentary. 

Sound  Slide  Projection  System  *  A  system  for  presenting  information 
by  means  of  an  audio  tape  and  a  series  of  synchronised  projected 
visual  slides. 


Student  Response  System  ~  AV  Supported  *  A  student  feedback  response 
syst«a  using  progranmed  audio  and/or  visual  presentations.  It  con* 
slats  of  four  major  components t  control  console  vith  response 
readouts,  student  responders,. audio  visual  devices,  and  a  programmer. 
Options  include  paper  tape  readouts  and  computer  interface  terminals. 

Teaching  Machine  -  Branching,  Still  Visual  with  Audio  *  An  indi¬ 
vidualised  instruction  syst^  cotaposed  of  iarge  step  multiple  choice 
programmed  instruction  frames  (still)  vith  synchronised  sound  and  a 
ptanually  controlled  device  to  select,  sequence  and  display  program 
frames  in  an  order  dependent  upon  the  trainee’s  last  response. 

\ 

Teaching  Machine  *  Branching.  Still  and  Motion  Visual  vith  Audio  - 
An  individualised  instruction  system  composed  oV large  s^ 
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choice  programmed  instruction  frames  (still  and  motion)  with  syn¬ 
chronized  sound  and  a  manually  controlled  device  to  select, 
se<iuence  and  display  program  frames  in  an  order  (i^endent  upon 
the  trainee's  last  response. 

.Toachihg  Machine  -  Branching,  with  Adjunct  Equipment  -  An  indi¬ 
vidualized  instruction  system  composed  of  large  step  multiple 
choice  programmed  Instruction  frames  (still  or  motion  with  .or 
without^ audio)  with  a  manually  controlled  device  to  select 
sequence  and  display  program  frames  in  an  order  dependent  upon  the 
trainee's  last  response.  Associated  with  this  equipment  is  a 
second  piece  of  equipment,  such  as  a  mock-up,  which  is  the  subject 
of  instruction  and  is  operated  according  to  instructions  from  the 
basic  teaching  machine. 

Teaching  Machine  -  Linear.  Still  Visual  with  Audio  -  An  indi¬ 
vidualized  instruction  system  composed  of  a  fixed  linear  sequence 
of  small  step  programmed  instruction  frames  (still  and  motion) 
with  synchronized  audio,  and  a  manually  controlled  device  to  dis¬ 
play  the  audio  and  visual  information. 

Teleconference  System  -  A  telecommunication  system  that  allows 
audio  and  visual  two-way  communication  between  two  or  more  remote 
locations. 

Television  -  Cable  (CATV)  -  A  hybrid  CCTV  system  offering  selective, 
multiple  channel,  encoded  progranuaing  to  cable  network  patrons.  A 
typical  system  consists  of  a  signal  receiving  antenna  system  for 
the  master  station  and  relay  of  amplified  signal  channels  via  area 
substations  to  system  subscribers.  Programming  may  also  be  gener¬ 
ated  and  transmitted  between  substations  offering  multiple  options 
for  conference  or  training.  Programs  are  encoded  for  privacy  and 
control  of  viewing  audience. 

Television  -  Cartridge  (CTV)  -  A  cartridge  television  system. (CTV) 
consists  of  packaged  video  tape  programs,  video  recorder,  playback 
and  display  units,  and  control  equipment  offering  high  selectivity 
and  availaollity  tor  individualized  programming.  Program  cartridges 
may  be  prerecorded,  locally  produced,  or  recorded  off-the-air. 

Television  ^  Closed  Circuit  (CCTV)  Without  Feedback  —  CCTV  without 
feedback  is  an  electronic  transmission  system  for  images  and  sound 
using  a  coaxial  cable  distribution  system.  System  design  includes 
one  or  more  studios  or  control  rooms,  a  signal  distribution  center, 
and  signal  distribution  cables  terminating  in  reception  areas 
equipped  with  receiver/monitors.  Off  air,  live  or  video  taped  pro¬ 
grams  may  be  used. 

with  Feedback  -  CCTV  with  feedback  is  the  trans¬ 
mission  of  a  live  presentation  with  audio  feedback  via  microphone 


or  telephone  in  each  receiving  classroom.  ,Live  instructor  is 
required  in  scudent-instructor~CCrV  loop  to  activate  the  feedback 
mode. 

58.  Television  -  Non-Magnotic  Video  Disc  System  -  An  experime-..cal  form 
o|  television,  similar  in  function  to  cartridge  television,  in 
wl)ich  the  program  is  encoded  on  a  thin  plastic  disc,  distributed  to 
users  where  it  is  rotated  at  high  revolutions  per  minute  on  a 
player  which  reads  the  data  and  sends  program  signals  into  the 
antenna  terminals  of  a  standard  color  television  receiver.  •  kandom 
access  capability. 

59.  Television  -  Open  Broadcast  -  Open  broadcast  television  is  the 
elccti'onic  transmission  of  images  with  accompanying  sound  from  a 
single  channel  VHP  and  UKF  station  and  shorter  range  multiple 
channel  2500  MHZ  systems. 

60.  Television  -  Portable  Video  Tape  System  -  A  low  cost  video  tape 
recording  and  playback  system  which  is  self-contained  and  portable. 
Typical  systems  consist  of  one  or  two  mobile  vidicon  cameras,  a 
small  scan  video  tape  recorder  and  a  monitor  receiver.  Immediate 
area  programming  and  open  broadcast  reception  and  recording  is 
standard. 

61.  Television  -  Video  Disc  with  Adjunct  Equipment  -  A  theoretical  con¬ 
figuration  of  a  video  disc  system  in  which  random  access  capabil¬ 
ities  are  used  by  a  trainee  in  retrieving  step-by-step  procedures 
and  diagnostic  routines  as  an  aid  in  performing  these  operations  on 
a  piece  of  equipment. 

CAX/aU 

Computer  As.qisted  Instruction  (CAI)  -  A  form  of  individualised 
insti-uction  that  employs  digital  computer  technology  to  manage  and 
display  information  to  a  student,  accept  student  responses,  provide 
knowledge  of  results,  and  select  subsequent  learning  event. 

63.  Computer  Assisted  Instruction  -  PLATO  IV  Basic  Configuration  -  An 
individualised  computer  baaed. teaching  system  being  developed  by 
the  University  of  Illinois  at  Urbana-Champaign ,  and  includes  up  to 
4096  terminals,  a  communication  network,  a  central  computer  and 
the  author  language  TUTOR. 

64 .  Computer  Assisted  Instruction  -  PI.ATO  IV.  Basic  Configuration  and 
Audio  -  System  includes  basic  configuration  of  PLATO  IV  plus  a 
random. access  audio  playback  system. 

•  Computer  Assist ed  Instruction  -  PI.ATO  IV,  Basic  Configuration  with 
Adjunct  .'.yv.:-  ■  T.t  -  Inc.v.dc.s  the  basic  terminal  with  externally 
connected  auxiliary  equipment. 


Computer  Assisted  Instruction 

a.  PLATO  IV  Configuration  with  adjunct  equipment  and  audio-terminal 
device  with  externally  connected  auxiliary  equipment  including 
random  access  audio  playback  system. 

b.  TICCIT  -  A  CAI  system  designed  by  Mitre  Corporation  which  allows 
the  student  to  manage  his  own  iiistruction.  In  this  type  of 
system,  the  computer  processes  information  about  student  achieve¬ 
ment  from  on-  or  off-line  terminals  and  directs  the  student  to  a 
sequence  of  off-line  training  modules  suited  to  the  student's 
style  of  learning  and  level  of  achievement. 

Computer  Simulation 

a.  On-Line  -  A  trainee  station  equipped  with  a  computer  terminal 
in  which  the  trainee  operates  in  direct  Interface  with  the  com¬ 
puter  as  part  of  the  program  loop.  By  his  Inputs,  the  trainee 
determines  his  allowable  performance  parameters  and  discerns 
the  effect  of  his  Inputs  upon  the  system  being  simulated. 

br  Off-Line  -  A  trainee  station  equipped  with  a  computer  terminal 
enabling  a  trainee  to  select  a  computer  simulation  program, 
enter  his  own  variables  (batch  processing)  and  run  the  simula¬ 
tion  to  determine  the  performance  of  the  simulated  system  under 
a  variety  of  conditions. 

Game  -  Computer  Supported  Simulation  -  Any  contest,  governed  by 
rules,  between  teams  or  individuals,  where  the  contest  is  a  dynamic 
model  of  some  real  system,  and  a  computer  is  used  in  performing  some 
of  the  calculations  necessary  for  the  operation  of  the  model  as  in 
cqmputer  supported  war  gaming. 

Game  -  Manual  Simulation  -  Any  contest  between  teams  or  individual 
players,  governed  by  rules,  where  the  contest  is  a  dynamic  model  of 
some  real  system,  and  is  played  without  the  aid  of  a  computer. 

Logic  Trainers  -  A  class  of  trainers  that  synthetically  allow  elec¬ 
tronic,  mechaulcal,  fluid  or  gaseous  conceptual  system  logic  training 
without  the  use  of  actual  hardware. 

Game  -  Computer  Simulation,  Solitaire,  with  Visual  Display  -  Any 
contest,  governed  by  rules,  between  a  single  player  and  a  computer 
with  visual  attachments  wheru.  the  contest  is  a  dynamic  model  of 
some  real  world  system  or  event. 

Operational  Equipment 


With  XcLr.<.,-:ls  -  A  ur.it  of  operational  equipment  being  used  for 
instructional  or  training  purposes  with  is  supporting  technical 


documentation  such  as  operator’s  guides,  maintenance  manuals 
and  'parts  lists.  May  be  an  electronic  black  box,  rifle,  or 
'  truck. 

Real  Environment  -  An  operational  system  used  for  training  such 
as  an  aircraft,  ship  or  track  vehicle.  Part  task,  full  task, 
sub-team,  team  or  multi- team  training  may  be  conducted  in  con¬ 
junction  with  or  independent  of  normal  operations. 

SNmthetically  Stimulated  -  An  operational  system  that  is  used 
for  training  by  interfacing  input  equipments  in  the  form  of 
tapes,  black  boxes,  or  computers.  Such  input  equipments 
present  programmed  data  to  the  operational  sysfceir.  allowing  it 
to  be  used  for  training  or  evaluative  purposes.  May  be  used 
for  part  teisk,  full  task,  sub-team,  multi-team  training  or 
combinations  thereof. 

73.  Physiological  Trainer  (Hostile  Environment)  Visual  -  A  training 
device  designed  to  place  controlled  stress  on  the  human  visual 
system,  through  the  use  of  physiologically  and/or  psychologically 
adverse  or  low  threshold  visual  signals,  to  enable  a  trainee  to 
learn  to  function  in  this  adversa  environment. 

7A.  Physiological  Trainer  (Hostile  Environment)  Surface  and  Internal 
Senses  -  A  broad  category  of  training  devices  designed  to  provide 
the  cutaneous,  kinesthetic  and  olfactory  sensors  with  physiologi¬ 
cally  and/or  psychologically  adverse  signal'.,  to  enable  a  trainee 
to  function  in  adverse  pressure,  temperature,  pain  or  disorientating 
motion  environments. 

75.  Procedure  Trainer 

a.  Basic  -  Training  hardware  designed  for  basic  training,  familiari¬ 
sation  or  transition  type  procedure  training  for  normal,  alter¬ 
nate  and  emergency  operation  of  operational  hardware.  Trainer 
systems  respond  with  a  lesser  degree  of  fidelity  of  performance 
than  is  required  for  simulators.  May  be  used  for  various  com¬ 
binations  of  part  task,  full  task,  sub-team,  team  or  multi-team 
training. 

b.  Adjunct  Displays  and  logic  -  Training  hardware  designed  for 
basic,  training,  familiarisation  or  transition  type  procedure 
training  for  normal,  alternate  and  emergency  operation  of 
operational  hardware.  Trainer  systems  respond  appropriately  to 
trainee  inputs  but  to  a  lesser  degree  of  fidelity  of  performance 
than  is  required  for  simulators.  May  be  used  for  various  com¬ 
binations  of  part  task,  full  task,  sub-team,  team  or  mul,ti-team 
training.  Adjunct  displays  ..nd  logics  uiay  include  scoring 
attachments,  adaptive  control,  automatic  demonstrations,  enhanced 
displays,  aucemated  briefing  and  debriefing  capability,  automatic 
coaching,  remedial  exercise  prescriptions  or  follow-on  assignments. 
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APPENDIX  B 


The  variable  descriptions  and  equation  logic  used  in  the 
Navy  costing  program  taken  from  TA£G  Report  Number  16  by 
permission  of  the  author. 


Because  the  costed  data  in  appendix  three  utilizes  a  large  number  of 

4 

variables,  it  was  believed  important  to  provide  the  reader  with  suffi¬ 
cient  information  to  specify  exactly  what  calculations  were  included 
in  each  result.  Since  the  calculations  are  nested  logically,  this  can 
only  be  done  through  a  complete  variable  and  equation  description  of 
the  costing  rationale.  The  relevant  information  is  thus  reproduced 
intact  ^rom  TAE6  Report  16  for  use  by  Arny  costing  personnel  who  may 
require  indepth  insight,  should  the  program  be  used  for  future  COEA's. 
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The  Input  varlebics  erfe  cUs&tfIcd  Into  seven  classes  as  follows: 
(1)  facilUios,  (2)  equipment,  (3)  Instructional  material  development, 
(4)  personnel,  (5)  students,  (6)  supplies,  and  (7)  miscellaneous.  A 
^hnitlon  of  each  variable  follows: 


1.  Facilities 

FACOST  Total  costs  of  facilities  acquisition 

and  revurbisl'.ir.s  WtMch  are  necessat^ 
for  implcrnontation. 

LCFFA  Expected  years  of  life  of  FACOST  assets. 

C?SQFT(l)  The  annual  cost  of  operation  and  maintenance 
of  facilities  por  square  foot  (includes 
operation,  tr.ai.vce.nanco,  janitorial  service, 
utilitios,  etc.).  Include  the  annual 
opportunity  costs  of  facilities  where  applicable. 

SQFTItH  Totat  square  feet  required  for  each  Instructor. 

SQFTST  Tntal  squaro  feat  required  per  ttudent  position. 

SQFTAM  Total  square  feet  required  far  administrative 

overhead. 


2,  Fouipment 

cQClSP  The  cost  of  equipment  necessary  for  implenenta* 

tion  (that  which  is  not  dependent  cn  the  number 
of  student  positions).  Do  not  include  equipment 
which  is  uniquely  associated  with  student 
posUions  (i.e.,  costs  inr.ludod  in  variable 
EQIMPC). 

LQFEQl  The  expected  years  of  life  of  equipment  included 

in  FqciSF. 

CAQSP(l)  Total  cost  of  equipment  to  be  acquired  in  each 

year  of  planninq  period  following  implementation. 
Include  .cost  of  equipment  which  represents 
expansion  or  addition  to  the  program  plus 
replacement  costs  for  that  equipment  included 
In  EQCISP. 

LOFCq(I)  The  expected  years  of  life  of  equipment  which 
has  been  included  in  CAQ$P(1). 
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OKFEQd) 


mm 


LOFEQ 


C0P«T(I) 


TSPOSO 


Total  annual  opcratloti  and  maintenance  cost  of 
fixed  equlpn-icr.t;  I.e. ,  the  operation  and  mainte* 
nance  cost  of  eculpmer.t  not  uniquely  related  to 
student  posit*! tr.s.  OuM  costs  of  equipment 
InCiudOu  *n  and  CAQSP(1}*  . 

The  cost  o'f  eC;U';?7.s.v;  (per  student  position) 
which  mast  ^*5  ucc,u;red  for  Iraplementation.  Do 
not  Include  equipment  which  is  not  uniquely 
related  to  student  positions  (I.e.*  do  not 
Include  equipment  costs  Included  In  variable 
EQCIS?). 

The  expected  years  of  life  of  student  position 
equipment;  I.e,,  equipment  Included  In  EQIKPC, 

Annual  operatlcr.,  maintenance,  and  replacement 
costs  of  equi  CiC»  soclatcd  with  each  student 
position  ii^  eat!)  year  of  the  planning  period; 
I.e.,  the  CaM  costs  of  equipment  Included  In 
variable  EQIH?C  and  the  replacement  costs  of 
any  student  position  related  equipment. 

The  percentage  of  planned  operating  time  the 
student  position  equipment  Is  nonfunctional 
because  of  unplanned  contingencies;  I.e., 
equipment  failure,  weather,  etc.  (percentage  of 
down  time  equals  one  minus  the  percentage 
availability). 


Instructional  Material  Developmar.t 

UlMO  The  percentage  of  time  spent  In  the  training 

medium  (for  the  nonrecycle'd  student)  for  which 
unique  hours  of  Instructional  material  must  be 
developed. 

UlKDYR(l)  The  number  of  unique  hcjfs  of  new  Instructional 
material  to  be  developed  In  each  year  of  the 
planning  period.  (The  model  assumes  that  any 
materiel  developed  and  reflected  in  this  variable 
Is  unique  to  the  course  and  will  be  fully 
depreciated  at  the  end  of  the  planning  period.) 
This  variable  doas  not  Include  any  updating  of 
original  course  material. 
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UraATC 

Updete  fector  for  tnstfucttonet  wteHol. 
Percentage  of  ttw  original  developeient  of 
instructional  Mterlal  expended  each  year  to 
wlntaln  the  courseware. 

EVIH 

The  percentage  of  the  origltuil  developiaent  cost 
df  Uie  Instmtional  material  which  reiaihs  at 
the  end  of  the  planning  pef1<M* 

CIMI^ 

AVirage  cost  of  developing  the  master  copy  far 
one  hour  of  instruction  (i*e.»  the  per  unit 
instructional  material  development  costs). 

a 

Ptrsonnel 

INTSPO 

Instructor-to-student  position  ratio. 

SALINR 

Average  annual  salary  and  benefits 
far  one  instructor. 

SUPPLY 

Average  cost  of  expendable  supplies  per  student 
while  in  the  ti^ining  medium. 

Students 

CRAO(l) 

The  number  of  students  who  must  be  trained  for 
each  yaar  of  tha  planning  periods  i.e.*  tha 
number  who  must  complete  the  program  and  graduata 

STUOSL 

Average  annual  salary  and  benefits  for  one 
student. 

STCSTl 

Average  student  travel  costs  to  end  from  school* 
Do  not  include  any  travel  done  es  part  of  the 
Course. 

STCST2 

Average  stud«tt  travel  costs  which  are  incurred 
as  part  of  the  course.  Do  not  include  eny 
costs  to  end  from  school. 

HIseelUneous 

K 

The  number  of  years  in  the  planning  period. 

(Ir  setting  the  plcnnlno  period,  guidance  can 
be  found  in  $£CNAVI»$T  ;000.14A.  pages  7  4  8.) 

s5“*.^'Ja'*’'^ 
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ARATE  The  attrition  rate.  Vha  percentage  of 

students  wno  enroil  in  the  program  but  never 
compicte  the  training. 

ORATE  The  discount  rate  (1C  percent  according  to 

DoD  Instraation 

KSCKOP  The  time  In  weehs  the  student  position  1$ 

available  per  year. 

TLENGK  The- average  time  in  \.'2ahs  spent  in  the  training 

oediun  for  the  nonrec^^cicd  student. 

TIEGTH  The  average  hours  per  week  the  student  spends 

in  the  medium. 

RCRATS  Recycle  rate  equals  the  percentage  of  students 

enrolling  in  the  training >'hd  will  repeat  some 
part  of  the  progrsa. 

ARCTTH  Average  recycle  time  in  vcaoks  equals  the 
average  amount  of  tir^  a  student  spends  in 
repeating  any  and  all  parts  of  the  course. 

CSR  TNe  percentage  of  student  positions  above  the 

computed  number  which  are  to  be  acquired  to 
provide  for  fluctuations  in  student  Inputs 
through  the  systen. 

The  following  variables  are  computed  by  the  (rodol  from  the  above 
Input  data: 


ORATE 


KSCKOP 


TLENGK 


TLEGTH 


RCRATS 


ARCTTH 


1.  Facilities 
tSQFT 

FCOST(l) 


2.  Souipment 
NSRRCD 


Total  square  feat  of  facilities  required; 

TSQFT*(SQFTST){?5?)+(i.';VSP0)(?5P)(SQFTlN)+SQFrAH. 

Total  cost  of  facilities  for  each  year  of 
tha  planning  peripo: 

FCOST(I)«(TSQrT)(CI>Sv^{I)J> 


Number. of  student  positions  required  for  the 
system;  " 


‘T~-^  «n- 
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NSPR(  I  )•  ( (SM'.v'RRCd  i-^STUGir-id) )/  {USCK0?)/(1  -TSOPSO) . 

KXSP  Mean  nurJbar  of  student  posUions  for  planning 

period: 

p^vs?-  'j’KSPAdV;;. 
i-i 


PSP 

Planned  r.u.r.ba;*  c;  student  positions; 

ps?•mpvds?)(:•t1S/^ 

CAQCI 

Cqulpn'.cr.t  acquisition  costs  necessaPy  for 
Implementation: 

EAQci*{EQixpc)(?s?)^(:.;:;s?). 

TAEQCd) 

Total  annual  oporot1cr.«  malntonance  and  equipment 
acquisition  costs  for  each  year  of  the  planning 
period: 

TAEQC{  I  )-{CAQS?d  >SCC?;'T(  I ) )  (PSP)^HFEQd ) . 

h 

Annual  doproclotlon  of  student  position  equip¬ 
ment: 

E3  -  (EQIM?C)(PS?)/tO.-fcQ. 

R 

Internal  computed  vsricbla  Indicating. the  years 
of  life  remaining  In  equipment  at  end  of  plan¬ 
ning  period. 

RVEQ 

Remaining  value  of  scudenu  ..osUlon  equipment 
at  end  of  pUnnl.''.';  period: 

RVEQ-(R)(E3). 

Rveqa 

Remaining  value  of  equipment  purchased  In  each 
year  of  plann-lnn  period  (-  for  all 
(LOFEQd)  -N)diO); 

RVEQ2-S{LO?GQd)-'0  *  (CAQSPd)/lOF£Qd)). 
l»l 
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NSPR(  I )-  ( (SKliRRCC  I  )  )/(WSCKC?)/{l  -TSOPSO) 

M^an  nincbsr  of  student  ^sttlons  for  planning 
perlou: 


KIS?' 


Planned  r.u.r.bsr  cv  ;Udcr.t  pos1t*;ons: 

ps?-kxspvC£S?)(:;j{$?). 

Cqulpntent  ccquUUIor.  costs  necessaiV  for 
Intplcinsnt&tlo;'.: 

EAQci-{EQixpc){?s?H(:.;;:s?). 

Total  annual  oparotlcn*  malntananco  and  e<;u1pment 
acquisition  costs  for  each  year  of  the  planning 
parlod: 

TAEQC(l)-(CAQS?(:>(CC?W(l5)(PSP)40HFEQ(I). 

Annual  depreciation  of  student  position  oqulp- 
runt: 


E3  •  (EQIHPC)(PSP)AO?£Q. 

Internal  computed  variable  Indicating. the  years 
of  life  remaining  In  equipment  et  end  of  plan¬ 
ning  period. 

Remaining  value  of  U  vU^Cm  V  ..ositlon  equipment 
at  end  of  planning  period: 

RVEQ-(R)(E3), 

Remaining  vales  of  eqelpt^'Ont  purchased  In  each 
year  of  plcnn-lnn  parlod  (-  for  all 
(LOFEQ(I)  -N):iO): 

i; 

RVEQ2«2(l.0?£Q(i)-.\)  *  (CAQSP{l)/LOFEP<(I)). 
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AASIN 

Average  annual  student  Inputs  required  to  provide 
the  nwnber  of  graduates  specified  In  each  year: 

AASIN- WjO(I)/N. 

1-1 

STUDWd) 

Total  time  requit'ed  In  training  for  all  students 
In  each  year  of  planning  period  to  train  the 
required  number  of  students  (to  specified 
objectives)  utilizing,  the  media  set  under 
consideration  (exclude  recycle  time): 

$TU0riW( 1 )-(TLEN6H)(STUD( I ))(1 5(ARATE)) . 

SNURRC(I) 

Total  time  required  for  recycling  for  all 
students  In  each  year  of  planning  period: 

SHUqRC( 1 )«(RCRATE) (STtlD( 1 ) ) ( ARCYTM) . 

AOB(I) 

Average  nuiRbar  of  students,  on  board  for  each 
yHrt 

A0e( 1 )-(SMURRC(I )4$TU0NW( 1 ) )/WSCH0P. 

AMI 

Mean  number  of  students  on  board  for  entire 
planning  period: 

aaob-I;  MI(1)/N. 
!•! 


TRAVEL  Totol  onnuAl  trmi  costs  for  ill  students: 

TRAVEL-(AASIN) (STCSTl )t(STCST2 ) (AASIN) 

(1-O.S  ARATE). 

SSALRY(l)  Totti  costs  of  student, selery  end  benefits  for 
•11  students  for  uch  yeer  of  plsnnlng  period: 

SSALRY(I)«((^C(I)fSTUDMU(I))/S2){STU0SL). 

Supplies 

SUPPY(I)  Total  cost  of  student  supplies  for  each  year 
in  planning  period: 


SU»PY(I}«(ST1»(1))($UPPLY). 


7,  M1sc«1Uneou8 
UOACST(I) 


KVAS 


PVALUC 


CINT 


ANCSP 


AOCSP 


'OWSi>W 
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Total  nondlscountcd  costs  for  oach  yoar 
In  planning  period: 


UOACST(l)-FCOST(nf 
♦CIMSTR 

4SSALRY 


TAEQC{IHAIHHC(I) 
I  ♦SUPPY(I) 
nnRAVEL. 


Total  nondlscountod  cost  of  aUornatlvti 


Ha- ^  UOACSTd )^FAC0ST4EAQCI«ACIH0 

1-1  u 

-  RVAS/(140RATE)". 

Retnalnlng  value  of  equipment  and  Instructional 
material  at  end  of  planning  parlodt 

RVAS-RVEQ^RVimRVFA 

Pnient  value  (cost)  of  aUarnatIvit 

N 

pvalue-23  ((ucacst(;}(2«drate))a 

Average  discounted  costs  per  student  position: 
C3-PVALUE/PSP 

Initial  system  acquisition  costs  for 
facilities,  equipment,  and  Instructional 
material  development: 

CINT-FACOSTtEQACI+ACIMO., 

Average  annual  nondlscounted  costs 
per  student  position. 

ANCSP-H^/OlKPSP) 

Average  annual  discounted  costs  per 
student  position: 

AOCSP»PVALUE/(N)(PSP) 


i  . 


I 


i 


I 
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ACSP 


IMC 


Initial  system  acquisition  costs  for 
fac111ttes«  equipment*  and  Instructional 
material  development  per  student  position 

ACSP-CIKT/PSP. 

UnUonR  Minual  costs: 

WC-PVALUE/^;^^  |24DRATE}/(2(14DRATC)^)]. 
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APPENDIX  G 


The  costed  components  of  an  aUe»*nate  program  for  training  the  25(L) 
MOS  in  tne  AN/rSQ-73  missile  minder.  Components  are  costed  on  the 
basis  of  a  17-week,  3S-hour  per  week  class  period.  A  total  cost  for 
the  program  could  be  calculated  as  the  sum  of  the  component  costs 
multiplied  by  their  percentage  of  use  given  at  the  top  of  each  com¬ 
ponent  listing.  Full  details  of  all  calculations  are  given  in 
appendix  two.  Input  data  from  USAAOS  is  listed  for  each  component 
on  average  and  life  cycle  basis  for  a  20-year  costing  period. 
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